Applicability of Deep Reinforcement Learning for Efficient Federated Learning in Massive IoT Communications
نویسندگان
چکیده
To build intelligent model learning in conventional architecture, the local data are required to be transmitted toward cloud server, which causes heavy backhaul congestion, leakage of personalization, and insufficient use network resources. address these issues, federated (FL) is introduced by offering a systematical framework that converges distributed modeling process between participants parameter server. However, challenging issues participant scheduling, aggregation policies, offloading, resource management still remain within FL architecture. In this survey article, state-of-the-art solutions for optimizing orchestration communications presented, primarily querying deep reinforcement (DRL)-based autonomy approaches. The correlations DRL mechanisms described optimized system architectures selected literature observable states, configurable actions, target rewards inquired into illustrate applicability DRL-assisted control self-organizing systems. Various deployment strategies Internet Things applications discussed. Furthermore, article offers review challenges future research perspectives advancing practical performances. Advanced aspects will drive converged autonomous communication-efficient privacy-aware learning.
منابع مشابه
Data-efficient Deep Reinforcement Learning
Grasping an object and precisely stacking it on another is a difficult task for traditional robotic control or hand-engineered approaches. Here we examine the problem in simulation and provide techniques aimed at solving it via deep reinforcement learning. We introduce two straightforward extensions to the Deep Deterministic Policy Gradient algorithm (DDPG), which make it significantly more dat...
متن کاملEfficient Parallel Methods for Deep Reinforcement Learning
We propose a novel framework for efficient parallelization of deep reinforcement learning algorithms, enabling these algorithms to learn from multiple actors on a single machine. The framework is algorithm agnostic and can be applied to on-policy, off-policy, value based and policy gradient based algorithms. Given its inherent parallelism, the framework can be efficiently implemented on a GPU, ...
متن کاملApplicability of Reinforcement Learning
We describe our experiences in trying to implement a hierarchical reinforcement learning system, and follow with conclusions that we have drawn from the difficulties that we encountered. We present our objectives before we started, the problems we encountered along the way, the solutions we devised for some of these problems, and our conclusions afterward about the class of problems for which r...
متن کاملDeep Reinforcement Learning for Resource Allocation in V2V Communications
In this article, we develop a decentralized resource allocation mechanism for vehicle-to-vehicle (V2V) communication systems based on deep reinforcement learning. Each V2V link is considered as an agent, making its own decisions to find optimal sub-band and power level for transmission. Since the proposed method is decentralized, the global information is not required for each agent to make its...
متن کاملFederated Control with Hierarchical Multi-Agent Deep Reinforcement Learning
We present a framework combining hierarchical and multi-agent deep reinforcement learning approaches to solve coordination problems among a multitude of agents using a semi-decentralized model. The framework extends the multi-agent learning setup by introducing a meta-controller that guides the communication between agent pairs, enabling agents to focus on communicating with only one other agen...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied sciences
سال: 2023
ISSN: ['2076-3417']
DOI: https://doi.org/10.3390/app13053083